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(54) Optimization method for a fuzzy neural network 

(57) An optimization method for a fuzzy neural net- 
work or fuzzy or neural network, wherein the process of 
calculating ah inference value by fuzzy inference is con- 
stituted with a neural network: A parameter to be identi- 
fied or adjusted by fuzzy inference is made to 
correspond to the coupling weight of the neural network, 
and a fuzzy rule and/or membership function is adjusted 
by updating the coupling weight by learning. A plural 
number of input candidate data that can be input data at , 
least to the fuzzy neural network are prepared in 
advance, using an evolutionary algorithm, information 
on adoption or non-adoption of at least respective input 
data are made into a plural number of individuals, and 
the individuals are made to evolve according to esti- 
mated accuracy using the evolutionary algorithm. * 
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Description 

[0001] This invention relates to an optimization 
method for a fuzzy neural network or fuzzy or neural 
network, wherein the process of calculating an infer- 
ence value by fuzzy inference is constituted with a neu- 
ral network, a parameter to be identified or adjusted by 
fuzzy inference is made to correspond to the coupling 
weight of the neural network, and a fuzzy rule and/or 
membership function is adjusted by updating the cou- 
pling weight by learning. 

[0002] Conventionally it has been practiced to consti- 
tute a fuzzy neural network as a combination of fuzzy 
inference and a neural network, in which the fuzzy infer- 
ence is capable of linguistically stating, by the use of if- 
then type fuzzy rules, an algorithm having ambiguity as 
in a human decision and in which the neural network is. 
capable of identifying any input-output relationship by 
updating coupling factors by a learning function, so that 
the fuzzy neural network has the advantages of both of 
fuzzy inference and the neural network : 
[0003] In such fuzzy neural network, the antecedent 
membership function in the fuzzy inference is repre- 
sented with a sigmoid function or the like, the central 
position and the gradient of the membership function 
and the output values of the fuzzy rule are made to cor- 
respond to the coupling weights of the neural network, 
and the correction or the like of the shape of the mem- 
bership function is possible by the use of a learning 
method such as the back propagation method. 
[0004] The fuzzy neural network constituted as 
described above has an advantage that it is optimized 
by learning within the range of the input information, 
irrespective of the type of input information used for 
obtaining the output information intended for estimation 
because the correction or the like of the configuration of 
the membership function is possible by the use of a 
learning method such as the back propagation method. 
However, the decision on the type of information that 
would optimize the inference output information has 
been up to the design engineer. 
[0005] Therefore, the design engineer has to choose 
the best suited information from the information deemed 
to be related to the output information intended for esti- 
mation. 

[0006] However, there are various kinds of output 
irrformatiorrintended for estimation by the use of a fuzzy 
neural network or fuzzy or neural network. For example, 
the information such as the intake air rate in the engine 
control which requires an expensive sensor if direct 
detection is intended, the information that is very difficult 
to delect directly such as the rate of fuel injected from 
an injection device and adhering to the intake pipe wall 
or the evaporation speed of the adhering fuel, and the 
information that must be estimated from the information 
other than the subject of sensing because of sharing a 
sensor. As a matter of course, the kinds of output infor- 
mation and related pieces of information are many. 



Choosing the best information from among the pieces of 
^ related information, while also taking into consideration 
the combinations with other pieces of input information, 
is a very difficult work. Obtaining the types and combi- 

s nations of the best suited pieces of input information 
requires considerable amount of time and labor. 
[0007] Therefore, the decision on kinds and combina- 
tions of the output information has been up to the expe- 
rience and knowledge of the design engineer. A 

10 problem here has been that the chosen types and com- 
binations have not been always the optimum. 
[0008] Accordingly, it is an objective of the present 
invention to provide an optimization method as indi- 
cated above which is capable to obtain the types and 

15 combinations of pieces of input information best suited 
for the output information automatically within a short 
period of time. 

[0009] According to the present invention, this objec- 
tive is solved for an optimization method as indicated 

20 above in that a plural number of input candidate data 
that can be input data at least to the; fuzzy neural net- 
work are prepared in advance, using an evolutionary 
algorithm, information on adoption or non-adoption of at 
least respective input data are made into a plural 

25 number of individuals, and the individuals are made to 
evolve according to estimated accuracy using the evolu- 
tionary algorithm. 

[0010] Accordingly, it is possible to optimize the 
number and the types of the input data to at least the 

30 fuzzy neural network or fuzzy or neural network. 

[0011] In order to optimize the value of the coupling 
weight, it is advantageous when the coupling weight 
corresponding to.the membership function is made into 
plural number of individuals by coding, and the individu- 

35 als are made to evolve according to estimated accuracy 
using the hereditary algorithm. 

[0012] Although this optimization method is usable to 
all fuzzy neural networks or fuzzy or neural networks, it 
is advantageous when the fuzzy neural network is 
40 applied to controlling an engine, whereas the input can- 
didate data include those related to the operation state 
of the engine. 

[0013] In that case, it is possible to use a plurality of 
data related to the operation state of the engine as the 

45 input candidate data. 

[0014] According to an advantageous embodiment of 
the invention, said fuzzy neural network uses six 
processing layers. In that case, it is advantageous when 
said fuzzy neural network uses the first through fourth 

so layers for constituting an antecedent portion and fifth 
and sixth layers for constituting a consequent portion. 
[0015] In addition, the present invention has the 
advantage when said fuzzy neural network is used to 
control an object or an engine, respectively, that said 

55 optimization process is carried out during the execution 
of the control. 

[0016] However, in case the optimization process has 
come to an end, it is possible to carry out the learning 
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process. 

[0017] Other preferred embodiments of the present ^ 
invention are laid down in further dependent claims. 
[0018] In the following, the present invention is 
explained in greater detail with respect to several s 
embodiments thereof in conjunction with the accompa- 
nying drawings, wherein: 

FIG. 1 is a schematic drawing showing the relation- 
ship between an engine. 1 and a control device 10 to 
capable of carrying out the air-fuel ratio control 
employing the optimization method for the fuzzy 
neural network according to the invention. 

FIG. 2 is a schematic block diagram showing the 15 
constitution of the control device 10. 

FIG. 3 is a schematic block diagram showing the 
constitution of the engine revolution calculating sec- 
tion. 20 



FIG. 15 is a schematic block diagram showing the 
constitution of the learning signal calculating sec- 
tion. 

FIG. 16 is a schematic block diagram of the second 
embodiment of the control device constituted to 
carry out the optimization process for the fuzzy neu- 
ral network during the execution of control under 
the same conditions as in the first embodiment. 

FIG. 17 shows the internal constitution of the data 
processing section of the second embodiment. 

FIG. 18 is a schematic block diagram showing the 
constitution of the model base control section of the 
second embodiment. 

FIG. 19 is a schematic block diagram showing the 
constitution of the intake air rate calculating section 
of the second embodiment. 



FIG. 4 is a schematic block diagram showing the 
constitution of the data processing section. 

FIG. 5 is a schematic block diagram showing the 
constitution of the model base control section. 

FIG. 6 shows the internal constitution of the intake 
air rate estimating section. 

FIG. 7 is a flow chart of the optimization process for 
the fuzzy neural network using a hereditary algo- 
rithm. 

FIG. 8 is a conceptual diagram showing the rela- 
tionship between the gene information to be coded 
in an optimization process and the coded individu- 
als. 

FIG. 9 shows the internal constitution of the intake 
fuel rate estimating section. 

FIG. 10 shows the internal constitution of the fuel 
adhesion rate estimating section. 

FIG. 11 shows the internal constitution of the evap- 
oration time constant estimating section. 

FIG.. 12 shows the internal constitution of the esti- 
mated air-fuel ratio calculating section. 

FIG. 13 is a schematic block diagram showing the 
constitution of the target air fuel ratio calculating 
section. 

FIG. 14 is a schematic block diagram showing the 
constitution of the internal feedback calculating 
section. 
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FIG. 20 is a schematic block diagram showing the 
constitution of the learning and evaluation signal 
calculating section of the second embodiment. 

FIG. 21 is a conceptual diagram showing another 
embodiment of the method of generating individu- 
als in the optimization process. 

FIG. 22 shows in (a) the input-output relationship of 
a basic form of the fuzzy neural network, and in (b) 
and (c) applied forms of the fuzzy neural network." 

FIG. 23 shows an example of the fuzzy neural net- 
work optimized for estimating the amount of torque 
variation. 

FIG. 24 shows an example of the fuzzy neural net- 
work optimized for estimating the engine combus- 
tion temperature. 

FIG. 25 shows an example of the fuzzy neural net- 
work optimized for estimating the intake pipe wall 
temperature. 

[0019] Several embodiments of the optimization 
method for the fuzzy neural network of the invention will 
be hereinafter described in reference to the appended 
drawings. The description relates likewise to fuzzy or 
neural networks. 

[0020] First, a first embodiment of the invention will be 
described in reference to FIGs. 1 through 15 in which 
the optimization method for the fuzzy neural network is 
applied to the control of the air-to-fuel ratio (ai^fuel 
ratio) of an engine. 

[0021 ] FIG. 1 is a schematic drawing showing the rela- 
tionship between an engine 1 and a control device 10 
capable of carrying out the air-fuel ratio control employ- 
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ing the optimization method for the fuzzy neural network 
according to the invention. 

[0022] The engine I is of the four-cycle type in which 
mixture is introduced into the combustion chamber of a 
cylinder 4 through an air cleaner (not shown) and a fuel 
injection device 3 disposed at an intake pipe 2 f and the 
exhaust gas after combustion is discharged to the 
atmosphere through an exhaust pipe 5. 
[0023] The control device 1 0 controls the air-fuel ratio 
in the exhaust gas by manipulating the rate of fuel 
injected from the fuel injection device 3. 
[0024] The control device 10 is disposed at the intake 
pipe 2 as shown in FIG. I and constituted as follows: 
Data are detected with; a crank angle sensor 1 1 dis- 
posed at the crankcase 6, an engine temperature sen- 
sor 12 disposed at the cylinder block 7, an air-fuel ratio 
sensor 13 disposed at the intake pipe 2; an intake pipe 
vacuum sensor 14, an ambient temperature sensor 15, 
and an intake pipe wall temperature sensor 16 disposed 
integrally with (or additionally to) the control device 10; 
and inputted to the control device 10. The control device 
10 receives the input of those data to determine and 
output the amount of manipulation (namely injection sig- 
nal) for the fuel injection device 3 and is constituted to 
carry out learning and evaluation of the internal models 
that constitute the device. 

[0025] FIG. 2 is a schematic block diagram showing 
the constitution of the control device 10. 
[0026] The control device 1 0 comprises an engine rev- 
olution calculating section for calculating the engine rev- 
olution based on the crank angle signal taken from the 
crank angle sensor 1 1 , a data processing section for 
processing the intake air vacuum information taken from 
the intake pipe vacuum sensor 14 to make the informa- 
tion usable in a model base control section which will be 
described later, and the model base control section to 
which are inputted; data processed in the data process- 
ing section, the engine revolution, the intake pipe wall 
temperature information taken from the intake pipe wall 
temperature sensor 16, and the exhaust air-fuel ratio 
taken from the air-fuel ratio sensor 13, for determining 
the injection signal to be sent to the fuel injection device 
3 based on those input data. 

[0027] FIG. 3 is a schematic block diagram showing 
the constitution of the engine revolution calculating sec- 
tion constituted as shown in the figure to measure the 
period of the crank angle signal with a period measuring 
section and to convert the period into the engine revolu- 
tion with a period-to- revolution conversion section. 
[0028] FIG. 4 is a schematic block diagram showing 
the constitution of the data processing section consti- 
tuted as shown in the figure to calculate the average 
pressure per stroke with the per-stroke average pres- 
sure calculating section using the intake air pressure 
data, to calculate the minimum pressure within one 
stroke with the per-stroke minimum pressure calculating 
section, and to output those data (the per-stroke aver- 
age pressure and the per-stroke minimum pressure). 



[0029] FIG. 5 is a schematic block diagram showing 
^ the constitution of the model base control section. 
[0030] As shown in the figure, the model base control 
section comprises an intake air rate estimating section 

5 constituting an air system sequence model made by 
assuming the behavior of air in the intake pipe as a 
model, an intake fuel rate estimating section constitut- 
ing a fuel system sequence model made by assuming 
the behavior of fuel injected from the fuel injection 

10 device as a model, and an estimated air-fuel ratio calcu- 
lating section for calculating the estimated airfuel ratio 
based on the estimated intake air rate and the esti- 
mated intake fuel rate respectively estimated with the 
intake air rate estimating section and the intake fuel rate 

is estimating section. 

[0031] The model base control section further com- 
prises a target air-fuel ratio calculating section for calcu- 
lating a target air-fuel ratio based on the estimated 
intake air rate, and an internal feedback calculating sec- 

20 tion which calculates the injection fuel rate for the fuel 
injection device (namely injection signal to the fuel injec- 
tion device) based on the target air-fuel ratio and the 
estimated air-fuel ratio, and outputs the result to the fuel 
injection device of the engine and to the intake fuel rate 

25 estimating section. 

[0032] The model base control section further com- 
prises a learning signal calculating section to which are 
inputted the estimated air-fuel ratio, estimated intake air 
rate, actual exhaust air-fuel ratio, and engine revolution; 

30 for calculating the learning data for the intake air rate 
estimating section and the intake fuel rate estimating 
section based on those input data. 
[0033] FIG. 6 is a schematic block diagram showing 
the internal constitution of the intake air rate estimating 

35 section. 

[0034] As shown in the figure, the intake air rate esti- 
mating section comprises a fuzzy neural network to 
which are inputted the engine operation state data 
(average intake air pressure and the minimum intake air 
40 pressure per-stroke, and the engine revolution) other 
than the intake air rate which is the subject of sensing, 
and outputs the estimated value of the intake air rate 
which is the subject of sensing. 

[0035] This fuzzy neural network comprises six 
45 processing layers, with the first through fourth layers 
constituting an antecedent portion and the fifth and sixth 
layers constituting a consequent portion. 
[0036] Pieces of input information are divided into the 
membership functions, each defined with the equation 
so shown below and constituting the antecedent portion 
including the first through fourth layers, using the 
parameter wc representing the central position and the 
parameter wg representing the gradient of the sigmoid 
function as coupling factors. 

55 

f(x) = 1/1 + exp(-wg(xi + wc)) 
[0037] The consequent portion is divided into fuzzy 
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rules corresponding in number to the number of mem- 
bership functions of the antecedent portion. The outputs 
of the fuzzy rules are respectively expressed with cou- 
pling weights wf. A sum of products of respective out- 
puts and the grades of the antecedent portion 
membership functions are calculated and the resultant 
value is outputted as an estimated value produced with 
the center of gravity method of the fuzzy inference, 
namely as an estimated intake air rate. 
[0038] In the fuzzy neural network constituting the 
above-described intake air rate estimating section, the 
number and types of the input information, the coupling 
weights wo and wg representing the central position 
and gradient of the membership function, and the 
number of membership functions corresponding to 
respective input information data are optimized with a 
hereditary algorithm using those information data as 
genes, while taking the relationship with the consequent 
portion coupling weight wf into consideration. 
[0039] During the execution- of the control, the cou- 
pling weight wf is made learnable based on the learning 
signal 2 calculated in the learning signal calculating 
section, and a correction factor for the output (estimated 
intake air rate) of the fuzzy neural network is also made 
learnable based on the learning signal 1 calculated in 
the learning signal calculating section. The above-men- 
tioned correction factor is used to correct the output of 
the fuzzy neural network according to changes in the 
environment as when running on a slope. 
[0040] Here will be descrfoed the optimization process 
using the hereditary algorithm in which the number and 
types of input information to the fuzzy neural network 
constituting the intake air rate estimating section, and 
the values of the coupling weights wc and wg represent- 
ing the central position and the gradient of the member- 
ship function are determined. 

[0041] FIG. 7 is a flow chart of the optimization proc- 
ess of the fuzzy neural network using the hereditary 
algorithm. 

[0042] First, as shown in FIG. 8, the number and types 
of input information in the fuzzy neural network consti- 
tuting the intake air rate estimating section, the coupling 
weights wc and wg representing the central position and 
the gradient of the membership function, and the 
number of the membership functions are coded as 
genes to produce a first generation consisting of a plural 
number (100 for example) of individuals (step 1). 
[0043] Here, a plural number of input candidate data 
for use as the input information to the fuzzy neural net- 
work are prepared in advance. The data denoting 
whether the input candidate data is used or unused (in 
this embodiment. "0" denotes "unused" and "I" denotes 
"used") is used as a gene. As the input candidate data 
for estimating the intake air rate, the following can be 
considered for example; the average intake air pressure 
per stroke, minimum intake air pressure per stroke, 
maximum intake air pressure per stroke, intake air pres- 
sure at a specific crank angle, period of time in which 



the intake air pressure changes from the minimum to 
the maximum, period of time in which the intake air 
pressure changes from the maximum to the minimum, 
differential pressure between the minimum and maxi- 

5 mum pressures, intake air pulsation amplitude, period 
(interval) of the intake air pulsation and so oh. Since 
these data are checked for their suitability as the input 
information with the optimization process, the data may 
be of any type as long as they can be detected or proc- 

w essed. 

[0044] The information on the number, to be coded as 
a gene, of a membership function can be prepared so 
as to correspond to the input information. 
[0045] Next, the input information and the coupling 

is factor of the fuzzy neural network are fixed with one of 
the individuals produced in the step 1, the estimated 
value of the intake air rate is determined with the fuzzy 
neural network, the actual intake air rate is detected 
with a sensor such as an air flow meter, and learning of 

20 the consequent portion coupling weight wf is carried out 
for a specified number of times with the back propaga- 
tion (BP) method so as to reduce the difference 
between the estimated and the actually measured val- 
ues, namely to improve the estimation accuracy (step 

25 2). . ' 

[0046] After applying the process of the step 2 to all 
the individuals, an evaluation value is calculated 
according to the error between the estimated and meas- 
ured values for each of the individuals (step 3). 

30 [0047] After calculating the evaluation values for all 
the individuals, determination is made whether the error 
of the individual of the highest evaluation (elite individ- 
ual) is smaller than a tolerance value (step 4). If the 
error is smaller than the tolerance value, the fuzzy neu- 

35 ral network is determined as being optimized, and the 
optimization process is finished. The input information 
. and the coupling factor of the fuzzy neural network are 
fixed with the genes constituting the elite individual. 
[0048] In the case the error is greater than the toier- 

40 ance value as determined in the step 4, the fuzzy neural 
network is determined as not being optimized, and two 
parent individuals are selected from the first generation 
individuals so as to produce the next generation (step 
5). The selection of the parent individuals may be car- 

45 ried out by the roulette choice in which an individual 
having a higher evaluation value has a higher probabil- 
ity of being selected as the parent individual. 
[0049] When the parent individuals are selected, the 
selected parent individuals are made to cross each 

so other to reproduce a plural number of child individuals 
as the second generation (step 6). Incidentally, the 
mutual crossing of the parent individuals may be carried 
out by methods such as one-point crossing, two-point 
crossing, normal distribution crossing, and so on. By the 

55 way, when the number of the first generation individuals 
is 100, it may be arranged that the number of the child 
individuals produced by the crossing of the parent indi- 
viduals is 99 to which the elite individual of the first gen- 
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eration is added to produce 100 second generation 
individuals. Leaving the previous generation individual 
intact to the next generation as described above pro- 
vides an effect of shortening the time required for the 
optimization. 

[0050] In still another step, mutation is caused to the 
genes by changing the values of the genes at random at 
a certain probability for the plural number of child indi- 
viduals produced (step 7). 

[0051] After producing the second generation by the 
above-described process, the optimization process 
from the step 2 is repeated again. 
[0052] The above-described optimization process is 
repeated until the error between the estimated value 
(output from the fuzzy neural network) and the actually 
measured value of the intake air rate becomes smaller 
than the tolerance value. As a result, the input informa- 
tion and coupling factor most suited for estimating the 
intake air rate are automatically determined. 
[0053] Here, description returns to the constitution of 
the processing sections of the model base control sec- 
tion. 

[0054] FIG. 9 shows the internal constitution of the 
intake fuel rate estimating section. 
[0055] In the intake fuel rate estimating section, the 
behavior of the fuel injected from the fuel injection 
device is represented with a model consisting of the rate 
of the injected fuel that does not directly enter the inte- 
rior of the cylinder but adheres to the intake pipe wall, 
the intake valve/etc. (hereinafter referred to as the fuel 
adhesion rate x) and the speed at which the fuel that 
has adhered to the intake pipe wall, the intake valve, 
etc. evaporates (hereinafter referred to as the evapora- 
tion time constant r). With the above -described 
arrangement, the intake fuel rate estimating section 
estimates the fuel entering the cylinder based on the 
fuel injection rate inputted from the internal feedback 
calculating section, the fuel adhesion rate, and the 
evaporation time constant To achieve the above- 
described function, the intake fuel rate estimating sec- 
tion comprises a fuel adhesion rate estimating section, 
an evaporation time constant estimating section, a non- 
adhesion fuel calculating section, an adhesion fuel cal- 
culating section, and an evaporation fuel rate calculat- 
ing section. 

[0056] The fuel adhesion rate estimating section as 
shown in FIG. 10 comprises a fu2zy neural network 
which receives the input data of the engine operation 
state (the engine revolution and the estimated intake air 
rate) other than the fuel adhesion rate to sense, and 
outputs the fuel adhesion rate to be sensed. 
[0057] The evaporation time constant estimating sec- 
tion as shown in FIG. 11 comprises a neural network 
which receives the input data of the engine operation 
state (the intake pipe wall temperature, the engine revo- 
lution, and the estimated intake air rate) , other than the 
evaporation time constant to sense and outputs the esti- 
mated value of . the evaporation time constant to be 



sensed. 

~ [0058] The fuzzy neural network constituting the fuel 
adhesion rate estimating section and the evaporation 
time constant estimating section, as well as the above- 

5 described fuzzy neural network constituting the intake 
air rate estimating section, comprises six processing 
layers, with the first through fourth layers constituting 
the antecedent portion using as coupling factors the 
parameter wc representing the central position and the 

10 parameter wg representing the gradient of the sigmoid 
function, and with the fifth and sixth layers constituting 
the consequent portion using as coupling weights the 
outputs wf of the nine fuzzy rules corresponding to the 
number of the membership functions of the antecedent 

75 portion. With the above-described constitution, a sum of 
products of the grades of the membership functions and 
the corresponding coupling weights wf is determined 
and the result is outputted as the value estimated with 
the barycentric method of fuzzy inference, namely the 

20 estimated fuel adhesion rate and the estimated fuel 
evaporation time constant. 

[0059] The number and types of the input information, 
and the values of the coupling weights wc and wg rep- 
resenting the central position and the gradient of the 

25 membership function in the fuzzy neural network can be 
determined by the optimization process according to the 
hereditary algorithm while taking into consideration the 
relationship with the consequent portion coupling 
weight wf. The coupling weight wf constituting the con- 

30 sequent portion is constituted to be learnable with the 
: learning signals 3 and 4 obtained with the learning sig- 
nal calculating section during the execution of the con- 
trol 

[0060] The non-adhesion fuel calculating section cal- 
35 culates the rate of fuel entering the combustion cham- 
ber of the cylinder directly from the fuel injection device 
according to the estimated fuel adhesion rate x obtained 
from the fuel adhesion rate estimating section and to the 
fuel injection rate obtained from the internal feedback 
40 calculating section, 

[0061] The adhesion fuel calculating section calcu- 
lates the rate of fuel injected from the fuel injection 
device and adhering to the intake pipe wall, the intake 
valve, etc. according to the estimated fuel adhesion rate 
45 x obtained from the fuel adhesion rate estimating sec- 
tion and to the fuel injection rate obtained from the inter- 
nal feedback operation section. 

[0062] The first evaporation fuel rate calculating sec- 
tion calculates the rate of fuel evaporating from the fuel 

50 adhering to the intake pipe wall, the intake valve, etc. 
based on the evaporation time constant r estimated with 
the evaporation time constant estimating section and on 
the adhesion fuel rate obtained with the adhesion fuel 
rate calculating section. 

55 [0063] The second evaporation fuel rate calculating 
section calculates the rate of the fuel from the fuel injec- 
tion device evaporating before directly entering the com- 
bustion chamber of the cylinder based on the 
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predetermined evaporation time constant V. Inciden- 
tally, since the time constant x' for the fuel directly enter- 
ing the cylinder is very small, and its influence is very 
small, here it is assumed as an appropriate constant. 
[0064] The intake fuel rate estimating section calcu- 
lates and outputs the estimated value of the intake fuel 
rate by the processes in the above-described process- 
ing sections. 

[0065] Based on the estimated intake air rate Ae and 
the estimated intake fuel rate Fe respectively obtained 
from the intake air rate calculating section and the 
intake fuel rate calculating section constituted as 
described above, the estimated air-fuel ratio calculating 
section as shown in FIG. 12 calculates the estimated 
air-fuel ratio Ae/Fe. 

[0066] FIG. 1 3 is a schematic block diagram showing 
the constitution of the target airfuel ratio calculating sec- 
tion. 

[0067] The target air-fuel ratio calculating section 
comprises a changing rate calculating section for calcu- 
lating the rate of change in the estimated intake air rate 
and a map of the target air-fuel ratio versus the chang- 
ing rate, receives input of the estimated intake air rate 
obtained from the intake air rate estimating section, and 
outputs the target air-fuel ratio commensurate with the 
estimated intake air rate. 

[0068] FIG. 14 is a schematic block diagram showing 
the constitution of the internal feedback operation sec- 
tion. As shown in the figure, the internal feedback oper- 
ation section determines the fuel injection rate so that 
the error of the estimated fuel-air ratio obtained from the 
estimated air-fuel ratio calculating section relative to the 
target air-fuel ratio obtained from the target air-fuel ratio 
calculating section becomes smaller, and outputs the 
determined value to the fuel injection device and to the 
intake fuel estimating section. In FIG. 14, the symbol Kp 
denote the feedback gain. 

[0069] FIG. 1 5 is a schematic block diagram showing 
the constitution of the learning signal calculating sec- 
tion. 

[0070] As shown in the figure, the learning signal cal- 
culating section comprises an operation state detecting 
section and a learning signal generating section. The 
operation state detecting section receives the input data 
of engine revolution and estimated intake air rate and, 
based on those data, detects the current engine opera- 
tion state (for example a transient state or a stationary 
state). 

[0071 ] The learning signal generating section receives 
the input data of the error of the estimated air-flier ratio 
relative to the actually measured exhaust air-fuel ratio, 
and determines the learning signals 1 through 4 so that 
the error becomes smaller. 

[0072] Here, since the learning signals 1 and 2 are for 
the intake air rate calculating section, they are calcu- 
lated from the information obtained when the engine 
operation state is stationary. Since the learning signals 
3 and 4 are for the intake fuel rate calculating section, 



they are calculated from the information obtained when 

^ the engine operation state is transient. 

[0073] Furthermore, since the learning signal 1 is for 
the correction factor for correcting the output of the 

5 fuzzy neural network according to changes in the envi- 
ronment such as during the upward slope run as 
described before, it is issued in succession according to 
changes in the environment during the stationary state 
with a large gain. However, since the learning signal 2 is 

10 for the consequent portion coupling factor wf of the 
fuzzy neural network, whether it should be issued or not 
is determined according to the tendency of the output 
value of the learning signal 1 so as to avoid response to 
the error due to changes in the environment. Actually, 

is the learning signal I is continuously on the increase dur- 
ing the upward slope run while it is on the decrease dur- 
ing the downward slope run. In such cases, the 
environment is deemed to be changing, and the learn- 
ing with the learning signal 2 is not carried out. 

20 [0074] When there is no change in the environment, 
learning is carried out with both of the learning signals 1 
and 2. However, it is arranged that the gain is larger for 
the learning using the learning signal 1 than for the 
learning of the fuzzy neural network (FNN) using the 

25 learning signal 2. 

[0075] When the output of the learning signal 2 is 
determined according to the tendency of the output of 
the learning signal 1 as described above, the conse- 
quent portion coupling factor of the fuzzy neural network 

30 does not change in response to the environmental 
changes. As a result, unnecessary learning is not car- 
ried out and therefore, the output of the fuzzy neural 
network becomes stabilized. 

[0076] The first embodiment described above is con- 
35 stituted that the input information and the antecedent 
portion coupling factors of the fuzzy neural networks of 
respective estimating sections of the model base con- 
trol section are optimized in advance with the hereditary 
algorithm while taking into consideration the relation- 
40 ship with the consequent portion coupling weight wf and 
that only the learning of the consequent portion cou- 
pling weight wf is carried out during the execution of the 
control. However, the optimization of the fuzzy neural 
network is not limited to the first embodiment but may be 
45 constituted to be carried out during the execution of the 
control. 

[0077] FIG. 1 6 is a schematic block diagram showing 
the constitution of the control device as a second 
embodiment constituted to carry out the optimization 

so process of the fuzzy neural network during execution of 
the control under the same conditions as those of the 
first embodiment. In the following, only the processing 
sections that are different from those in the first embod- 
iment are explained, and explanation of other process- 

55 ing sections is omitted. 

[0078] The model base control section is constituted 
that the optimization process of the fuzzy neural net- 
work constituting its intake air rate estimating section 
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can be carried out during the execution of the control. 
[0079] The data processing section as shown in FIG. 
1 7 processes the intake air pressure data to produce 
input candidate data for the fgzzy neural network consti- 
tuting the intake air rate estimating section in the model 
base control section. 

[0080] FIG. 1 8 is a schematic block diagram showing 
the constitution of the model base control section. As 
described before, the intake air rate estimating section 
comprises a fuzzy neural network that uses the input 
information data other than the sensing subject and out- 
puts the intake air rate to be sensed, and is constituted 
to carry out the optimization process of the fuzzy neural 
network during the execution of the control. The learn- 
ing and evaluation signal calculating section calculates 
and outputs, in addition to the learning signals for the 
fuzzy neural network of the intake fuel rate calculating 
section and the intake air rate calculating section, eval- 
uation signals to be used for the optimization process in 
the intake air rate calculating section. 
[0081] FIG. 19 is a schematic block diagram showing 
the constitution of the intake air rate calculating section. 
As shown in the figure, the intake air rate calculating 
section comprises an optimization process executing 
section which receives the input of various input candi- 
date data including the data processed in the data 
processing section and generates by coding the input 
data a plural number of individuals (chromosomes) 
using the data denoting whether the input candidate 
data are used or unused (in this embodiment, "0" stands 
for "unused" and "J " for "used") and the antecedent por- 
tion coupling weights we and wg as genes. The fuzzy 
neural network is optimized while selecting from among 
the individuals according to the evaluation signals 
obtained from the learning and evaluation signal calcu- 
lating section. Since the optimization process using the 
hereditary algorithm is basically the same as that of the 
first embodiment, explanation thereof is omitted. 
[0082] The optimization process in the intake air rate 
estimating section is started at appropriate time inter- 
vals, or when a specified condition is met, or by a direct 
instruction by a user. When the optimization process is 
not being carried out, a learning process can be carried 
out with the learning signal obtained from the learning 
and evaluation signal calculating section, like the intake 
air rate estimating section explained with the first 
embodiment. 

[0083] FIG. 20 is a schematic block diagram showing 
the constitution of the learning and evaluation signal 
calculating section. 

[0084] The learning and evaluation signal calculating 
section, like that of the first embodiment, when the opti- 
mization process is not carried out in the intake air rate 
estimating section, calculates and outputs the learning 
signals I and 2 for the intake air rate estimating section 
or the learning signals 3 and 4 for the intake fuel rate 
estimating section according to the operation state of 
the engine. 



[0085] When the optimization process is being carried 
^ out in the intake air rate estimating section, evaluation 
signals of respective individuals, in addition to the 
above-described learning signals 1 through 4, are out- 

s putted from the evaluation signal generating section 
according to the error between the estimated and meas- 
ured values of the air-fuel ratio. 
/ [0086] In the intake air rate estimating section, during 
the optimization process, learning of the consequent 

io portion coupling weight wf is carried out when the fuzzy 
neural network is being operated using respective indi- 
viduals according to the learning signal 2 outputted from 
the learning and evaluation signal calculating section, 
and determines the evaluations of respective individuals 

is according to the evaluation signals. 

[0087] In the first and second embodiments describe 
so far, whether the optimization process is at its end is 
determined according to whether the output error of the 
fuzzy neural network is smaller than the tolerance value. 

20 However, the condition of the end determination is not 
limited to that in the above embodiments. It may also be 
arranged that the process is repeated for a predeter- 
mined number of generations, or that the evolution is 
stopped when the decreasing tendency of the output 

25 error is deemed to be converging. 

[0088] In the embodiments described above, both of 
the input information and the membership function of 
the fuzzy neural network are optimized using the hered- 
itary algorithm. However, this invention is not limited to 

30 the above embodiments and may also be embodied 
otherwise: As shown in FIG. 21 , only the types and the 
number of the input information as genes are coded and 
optimized by the hereditary algorithm. The membership 
function is optimized, as proposed by the applicants 

35 Japanese patent application No. Hei-9-91115, by add- 
ing fuzzy rules using the changing tendency of the cou- 
pling factor and the decreasing tendency of the error of 
the fuzzy neural network in the learning process as 
decision criteria. At the same time, using the lineality of 

40 the consequent portion coupling weights of at least 
three membership functions in the same input informa- 
tion as the decision criteria, when the coupling factors 
have lineality, at least one of the membership functions 
corresponding to the consequent portion weights is 

45 deleted. 

[0089] Furthermore in the above-described embodi- 
ments, while the fuzzy neural network of each estimat- 
ing section is constituted with the basic form fuzzy 
neural network as shown in FIG. 22(1), the constitution 

so of the fuzzy neural network is not limited to such an 
embodiment, but may be constituted otherwise as 
shown in FIGs. 22(2) or 22(3) in which outputs of a plu- 
ral number of fuzzy neural networks are summed up 
and outputted, or outputs of a plural number of fuzzy 

55 neural networks are further used as input data to 
another fuzzy neural network which in turn outputs data. 
Even if the fuzzy neural network is constituted in the 
complicated manner as described above, effects are 
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still provided that the selection of input information and 
that determination of respective coupling factors are 
made in a simple manner. 

[0090] Furthermore, while the above embodiments 
are described with the example. of the fuzzy neural net- 
work optimized by using the information on the engine 
operation state other than the intake air rate, fuel adhe- 
sion rate, or evaporation time constant as input candi- 
date data in order to estimate the sensing subject, the 
input candidate data for the fuzzy neural network are 
not limited to those used in the above embodiments. 
Rather, it is a matter of course that the input candidate 
data may be set at will according to the sensing subject. 
For example, in the case the amount of variation in 
torque as the detection subject is to be estimated, the 
fuzzy neural network may be optimized using time 
sequential data or the tike of the amount of variation in 
revolution, engine revolution, intake air rate, and com- 
bustion chamber pressure as the input candidate infor- 
mation (as shown in FIG. 23 as an example of a fuzzy 
neural network optimized for est mating the amount of 
torque variation). Furthermore, in the case the combus- 
tion chamber temperature as the sensing subject of an 
engine is to be estimated, the fuzzy neural network may 
be optimized using the intake pipe wall temperature, 
intake pipe ambient temperature (atmospheric tempera- 
ture), and the time elapsed after starting the engine as 
the input candidate information (as shown in FIG. 24 as 
an example of a fuzzy neural network optimized for esti- 
mating the combustion chamber temperature of the 
engine). Furthermore, in the case the intake pipe wall 
temperature as the sensing subject is to be estimated, 
the fuzzy neural network may be optimized using the 
cooling water temperature, oil temperature, and the 
engine (cylinder block) temperature as the input candi- 
date information (as shown in FIG. 25 as an example of 
a fuzzy neural network optimized for estimating the 
intake pipe wall temperature). 

[0091 ] In the first and second embodiments described 
above, since the description is made with an intake pipe 
injection type of engine, the intake air rate estimated in 
the intake air rate estimating section of the control 
device is the rate of the intake air flowing though the 
throttle valve. However, in the case the air-fuel ratio in 
an incylinder injection type of engine is controlled in the 
same manner, the fuzzy neural network may be consti- 
tuted so that the rate of intake air flowing into the cylin- 
der is estimated instead of the rate of intake air flowing 
through the throttle valve. 

[0092] In the first and second embodiments described 
above, since the description is made with the control of 
the air-fuel ratio of the engine as an example of the opti- 
mization method for the fuzzy neural network according 
to the invention, both of the input candidate data and the 
output data are related to the air-fuel ratio control for the 
engine. However, the subject of control to which the 
optimization method of the invention may be applied is 
not limited to the air-fuel ratio in the engine. The method 



may also be applied to any subject of control as a matter 

^ of course. 

[0093] Specifically for example, in the case a vehicle 
is to be controlled in many aspects as reflecting the 

5 preference of the user, for example, a fuzzy neural net- 
work for estimating the preference of the user for the 
vehicle may be optimized using input candidate data 
such as the amount of operating the accelerator or 
brake, shift travel, or pattern of change in the engine 

io revolution. 

[0094] Furthermore, in the case the subject of control 
is to be controlled in many aspects as reflecting the 
emotion or character of the user, a fuzzy neural network 
for estimating the emotion or character of the user may 

75 be optimized using input candidate data such as the 
facial expression, manipulation, speech, or physical 
movement of the user. 

[0095] In the case the speed of an electric motor-oper- 
ated vehicle is to be controlled, a fuzzy neural network 
20 for estimating the vehicle speed may be optimized using 
input candidate data such as the induced voltage of the 
motor, revolution, angular speed, or current of the 
motor. 

[0096] In the case the amount of electricity generated 
25 with a generator is to be controlled, a fuzzy neural net- 
work for estimating the required amount of electric 
power for consumption may be optimized using input 
candidate data such as the season, and the weather of 
the day. 

30 [0097] Furthermore, in the case the engine of an out- 
board motor with a water pump operated in connection 
with the engine crankshaft is controlled, a fuzzy neural 
network for estimating the engine temperature, may be 
optimized using input candidate data such as the in-flow 

35 cooling water temperature, out-flow cooling water tem- 
perature, engine revolution, or continuous operation 
time as the input candidate data. 
[0098] As described above, in the optimization 
method for a fuzzy neural network of this invention, the 

40 process of calculating an inference value by fuzzy infer- 
ence is constituted with a neural network, a parameter 
to be identified or adjusted by fuzzy inference is made to 
correspond to the coupling weight of the neural network, 
and a fuzzy rule and/or membership function is adjusted 

45 by updating the coupling weight by learning, and that at 
least a plural number of input candidate data that can be 
input data to the fuzzy neural network are prepared in 
advance, using a hereditary algorithm, at least informa- 
tion on adoption or non-adoption of respective input 

50 data are made into a plural number of individuals, and 
the individuals are made to evolve according to esti- 
mated accuracy using a hereditary algorithm, so that at 
least the number and the types of the input data to the 
fuzzy neural network are optimized. Therefore, an effect 

55 is provided that optimum types and number of input 
data for estimating the output information from among 
detectable pieces of information may be automatically 
selected within a short period of time and that a fuzzy 
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neural network of a higher estimation accuracy may be 
constituted. 

[0099] Furthermore, the output of the fuzzy neural net- 
work is .made to be the data of the detection subject 
required for control, and the input candidate data for the 
fuzzy neural network are made to be those of the oper- 
ation state of the engine that are not the sensing sub 1 
ject. As a result, for example, information that is difficult 
to sense directly or requires an expensive sensor to 
sense directly may be estimated indirectly. This results 
in the effects that a broad range of information can be 
used for the control and that the control device itself is 
made inexpensive because no expensive sensors are 
required. Furthermore, the use of the fuzzy neural net- 
work enables comprehensive use of a plural number of 
data. Since its input information may be optimized, a 
fuzzy neural network that is invulnerable to external dis- 
turbances may be constituted even in the case the 
detection subject data are estimated from other data. 

Claims 

1 . An optimization method for a fuzzy neural network 
or fuzzy or neural network, wherein the process of 
calculating an inference value by fuzzy inference is 
constituted with a neural network, a parameter to 
be identified or adjusted by fuzzy inference is made 
to correspond to the coupling weight of the neural 
network, and a fuzzy rule and/or membership func- 
tion is adjusted by updating the coupling weight by 
learning, 

characterized in that 

a plural number of input candidate data that can be 
input data at least to the fuzzy neural network are 
prepared in advance, using an evolutionary algo- 
rithm, information on adoption or non-adoption of at 
least respective input data are made into a plural 
number of individuals, and the individuals are made 
to evolve according to estimated accuracy using the 
evolutionary algorithm. 

2. An optimization method for a fuzzy neural network 
according to claim 1, characterized in that the 
coupling weight corresponding to the membership 
function is made into plural number of individuals by 
coding, and the individuals are made to evolve 
according to estimated accuracy using the heredi- 
tary algorithm. 

3. An optimization method for a fuzzy neural network 
according to claim 1 or 2. characterized in that the 
fuzzy neural network is applied to controlling an 
engine, and the input candidate data include those 
related to the operation state of the engine. 

4. An optimization method for a fuzzy neural network 
according to claim 3, characterized in that the 
input candidate data include at least one of a plural 



number of data related to the intake air pressure of 
the engine, and output data is the intake air rate to 
the cylinder of the engine. 

5 5. An optimization method for a fuzzy neural 1 network 
according to claim 3 or 4, characterized in that the 
input candidate data include at least one of the time 
sequential data of the combustion chamber pres- 
sure, the fluctuation in the engine revolution, the 

10 engine revolution, and the intake air rate, and the 
output data is the amount of fluctuation in the 
engine torque. 

6. An optimiziation method lor a fuzzy neural network 
is according to at least one of the preceding claims 3 

to 5, characterized in that the input candidate data 
includeaTleast oneof the intake pipe wall tempera- 
ture of the engine, the ambient temperature of the 
intake pipe, and the elapsed time from the start of 
20 the engine, and the output data is the temperature 
of the combustion chamber of the engine. 

7. An optimization method for a fuzzy neural network 
according to at least one of the preceding claims 3 

25 to 6, characterized in that the input candidate data 
include at least one of the cooling water tempera- 
ture, the oil temperature, and the engine tempera- 
ture, and the output data is the intake pipe wall 
temperature. 

30 

8. An optimization method for a fuzzy neural network 
according to at least one of the preceding claims 3 
to 7, characterized in that the input candidate data 
include at least one of the intake pipe wall tempera- 

35 ture, the engine revolution, the intake air rate, and 
the intake air vacuum, and the output data is the 
evaporation time constant of the fuel adhering to 
the intake pipe wall. 

40 9. An optimization method for a fuzzy neural network 
according to at least one of the preceding claims 3 
to 8, characterized in that the input candidate data 
include at least one of the engine revolution, the 
intake air rate, and the intake air vacuum, and the 

45 output data is the rate of injected fuel adhering to 
the intake pipe: 

10. An optimization method for a fuzzy neural network 
according to daim 8 or 9, characterized in that the 

so input candidate data further include at least one of 
changing rates of the throttle opening and the 
engine revolution, 

11. An optimization method for a fuzzy neural network 
55 according to at least one of the preceding claims 1 

to 10, characterized In that said fuzzy neural net- 
work uses six processing layers. 
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12. An optimization method for a fuzzy neural network 
according to claim 11, characterized in that said ^ 
fuzzy neural network uses the first through fourth 
layers for constituting an antecedent portion and 
the fifth and sixth layers for constituting a conse- 5 
quent portion. 

13. An optimization method for a fuzzy neural network 
according to at least one of the preceding claims 1 

to 12, characterized in that pieces of input por- 10 
tipns are divided into the membership functions, 
each defined by the equation 

f(x) = 1/1 + exp(-wg(xi + wc)), 

15 

wherein wg represents the gradient of the sigmoid 
function and wc represents the central portion of 
the sigmoid function, which are used as coupling 
factors. 

20 . \ 

14. An optimization method for a fuzzy neural network 
according to at least one of the preceding claims 1 
to 13, wherein said fuzzy neural network is used to 
control an object or an engine, respectively, char- 
acterized in that said optimization process is car- 25 
ried out during the execution of the control. 

15. An optimization method for a fuzzy neural network 
according to claim 14, characterized in that in 
case the optimization process has come to an end 30 
a learning process is being carried out. 
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